Learning from Narrated Instruction Videos
نویسندگان
چکیده
منابع مشابه
Learning from narrated instruction videos
Automatic assistants could guide a person or a robot in performing new tasks, such as changing a car tire or repotting a plant. Creating such assistants, however, is non-trivial and requires understanding of visual and verbal content of a video. Towards this goal, we here address the problem of automatically learning the main steps of a task from a set of narrated instruction videos. We develop...
متن کاملEye movements while viewing narrated, captioned, and silent videos.
Videos are often accompanied by narration delivered either by an audio stream or by captions, yet little is known about saccadic patterns while viewing narrated video displays. Eye movements were recorded while viewing video clips with (a) audio narration, (b) captions, (c) no narration, or (d) concurrent captions and audio. A surprisingly large proportion of time (>40%) was spent reading capti...
متن کاملWhen static media promote active learning: annotated illustrations versus narrated animations in multimedia instruction.
In 4 experiments, students received a lesson consisting of computer-based animation and narration or a lesson consisting of paper-based static diagrams and text. The lessons used the same words and graphics in the paper-based and computer-based versions to explain the process of lightning formation (Experiment 1), how a toilet tank works (Experiment 2), how ocean waves work (Experiment 3), and ...
متن کاملLearning Object States from Videos
In this work, we borrow the idea of states in automata to define states for objects that are common in our daily activities. When human interact with objects, the objects are likely to go through a series of state changes, altering their appearance and functionality from time to time. The goal of this project is to take an initial step toward enabling robots to obtain knowledge of unseen object...
متن کاملLearning Word Meaning And Grammatical Constructions From Narrated Video Events
The objective of this research is to develop a system for miniature language learning based on a minimum of prewired language-specific functionality, that is compatible with observations of perceptual and language capabilities in human development. In the proposed system, meaning is extracted from video images based on detection of physical contact and its parameters. Mapping of sentence form t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2018
ISSN: 0162-8828,2160-9292,1939-3539
DOI: 10.1109/tpami.2017.2749223